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DIGITAL CAMERA 



BACKGROUND OF THE INVENTION 
Technical Field of the Invention 

The present invention pertains to a digital camera that records images as 
5 electronic digital data. 

Description of the Prior Art 

In recent years, electronic still cameras (hereinafter 'digital cameras') that 
record images in a memory as digital data have started to become popular. In this 
type of digital camera, the image is normally formed on a CCD, which comprises 

10 the image pickup element, by means of an optical lens. The light energy is 
transferred into electrical signals by the CCD. The electrical signals are then 
converted into digital signals through analog/digital conversion (hereinafter 'A/D 
conversion') and stored in a memory. The digital data stored in the memory is 
displayed on a display unit incorporated in the camera or on a monitor coimected 

15 to an external device such as a personal computer. 

A CCD that is used as an unage pickup element senses brightness 
information only, and therefore a digital camera normally has color filters for 
individual pixels of the CCD so that the image information is separated into R 
(red), G (green) and B (blue) color data by means of these color filters, and then 

20 sensed. To obtain data of the three different colors from the pixels that are aligned 
in a matrix, a method that uses three CCDs, each of which is coated with a single 
color of red, green or blue, respectively, and a method that uses a single CCD, the 
pixels of which are alternately coated with red, green or blue, are conventionally 
used. For generally marketed digital cameras, the second method is normally 

25 used. The description provided in this disclosure assumes a digital camera having 
a single CCD. 

The signal processing sequence in a conventional digital camera, of the 
type described above, will be explained with reference to Fig. 11. In a digital 
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camera 61, where an image is formed on the CCD, an R, G or B pixel signal is 
obtained for each pixel by means of the R, G and B filters which are located in 
one-to-one relationship with individual pixels (S61). In step S62, these pixel 
signals are converted through A/D conversion, and digital image data is created 
5 (S63). In order to create a color image, single digital unage data comprising 
composite R, G and B pixel data is separated into individual sets of R, G and B 
pixel data, including missing pixels. In step S64, the missing pixels in the pixel 
data of each color are interpolated by means of a method incorporated in the 
camera, using the data from the surrounding pixels to create R, G and B complete 
10 pixel data. After that, the R, G and B complete pixel data is recorded on a 

recording medium, after being compressed if necessary (S66). A single color 
image is obtained by overlapping the complete pixel data. When this unage data is 
input to a personal computer ('PC') 70, the personal computer 70 expands it (S67), 
whereupon the unage data created by the digital camera 61 is obtained. 

15 Problems Addressed by the Invention 

In the digital camera 61 described above, the image data obtained from a 
single CCD is separated into R, G and B pixel data and missing pixels are 
interpolated for each color, after which the resulting R, G and B complete pixel 
data is recorded on a recording medium. Consequently, three times as much data 

20 as the actual information obtained from the single CCD is stored on the recording 
medium (see Fig. 12). Generally, a digital camera that handles image information, 
which typically includes more data than character information, faces the problem 
that the capacity of the data recording medium can turn out to be insufficient, and 
reduction in file sizes is therefore desirable. 

25 In the digital camera 61 described above, image data interpolation for 

missing pixels is performed usuig a method incorporated into the camera, but in 
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order for a camera to perform more sophisticated pixel data interpolation, it must 
have a more complex circuit or a larger program, which essentially entails an 
increase in cost. Further, where the digital camera 61 is used to display the 
image, image data interpolation is performed in the camera, and therefore the user 
5 caimot perform pixel data interpolation to his liking. 

The present invention was created in consideration of these technical issues. 
Its object is to reduce the load on the recording medium data storage capacity and 
to provide a digital camera in which the user can perform pixel data mterpolation 
regarding the image data. 

10 SUMMARY OF THE INVENTION 

In pursuit of this objective, a digital camera in accordance with the present 
invention employs an hnage sensor with color filters that correspond to individual 
pixels of the sensor. Image data detected by the sensor is recorded, together with 
data regarding the alignment of the color filters. The image data and the recorded 

15 alignment data are transmitted to a device external to the camera, where the image 
data is interpolated in accordance with the alignment data to produce complete 
color data for each pixel of the image. The complete color data is used to display 
the image. By means of this technique, the camera only needs to store and 
transmit the original image data, rather than interpolated complete image data. In 

20 addition, various interpolation processes can be employed in the external device, 
according to the particular desires of the user. 

Embodiments of the present invention will be explained in detail below 
with reference to the accompanying drawings. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram of a digital camera pertaining to a first 
embodiment of the present invention. 

Fig. 2 is a drawing showing R, G and B complete pixel data that is 
5 obtained from a single piece of image data. 

Fig. 3 is a drawing showing the signal processing sequence in the digital 
camera of Figure 1 . 

Fig. 4 is a drawing showing the manner in which the R, G and B pixel data 
is converted in the digital camera. 
10 Fig. 5 is a drawing showing four types of Bayer type arrays for the R, G 

and B filters. 

Fig. 6 is a drawing showing special alignments for the R, G and B filters. 

Fig. 7 is a drawing to explain the compression of the image data. 

Fig. 8 is a drawing showing the signal processing sequence in a digital 
15 camera pertaining to a second embodiment of the present invention. 

Fig. 9 is a drawing showing the signal processing sequence in a digital 
camera pertaining to a third embodiment of the present invention. 

Fig. 10 is a drawing showing R, G, and B pixel data that is subject to a 
second round of pixel interpolation in a personal computer. 
20 Fig. 11 is a drawing showing the signal processing sequence in a 

conventional digital camera. 

Fig. 12 is a drawing showing the maimer in which the R, G and B pixel 
data is converted in a conventional digital camera. 



DETAILED DESCRIPTION 

25 Fig. 1 is a block diagram of a digital camera 1. This digital camera 1 has 

an image pickup lens 2, an image pickup unit 3 comprising a CCD equipped with 
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color filters that separate the image signals into data of different colors, an A/D 
converter 4 that performs A/D conversion of the electrical signals, a signal 
processor 5 that performs image processing, such as white balance adjustment and 
gamma correction, of the digital signals obtained by means of the components 

5 described above, a first memory 6 that temporarily stores the unage data that has 
undergone signal processing in the signal processor 5, switches 7 including a 
shutter release switch, a CPU 8 that comprises a microcomputer and that controls 
the operations of the components and performs processing such as image data 
compression or expansion or pixel data interpolation, a display memory 11 that 

10 stores the image data to be displayed on the LCD display, and an LCD display unit 
12 that displays the captured image or recorded image. 

This digital camera 1 also has a second memory 10 that records the digital 
image data produced by the A/D converter 4. In this embodiment, a memory card 
that is detachable from the camera is used as the second memory 10. 

15 In Fig. 1, a personal computer 20 is shown as the external device to which 

the image data recorded in the second memory 10 is output. This personal 
computer 20 has a data input unit 21 to which the second memory 10 is connected 
and that reads the image data recorded in the second memory 10. The image data 
thus read is input to the personal computer 20. This personal computer 20 

20 performs expansion of the image data, pixel data interpolation and monitor display 
based on the programs stored in its memory. 

A CCD whose pixels are each coated with an R, G or B color filter is used. 
The R, G and B filters in this CCD are aligned such that G occurs in every other 
pixel in both the vertical and horizontal directions and R and B are aligned so as to 

25 form lines (a so-called Bayer type array). The alignment of the R, G and B filters 
is stored and processed as filter alignment data in the digital camera 1, which will 
be explained in detail below. 
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Where such a CCD is used, when image information is input to the CCD, 
image data comprising R, G and B pixel data is obtained, as shown in Fig. 2, by 
means of the R, G and B filters located so as to correspond to individual pixels. In 
order to construct a color image from this image data, the pixel data is first 
5 separated into R, G and B groups. 

Pixels that do not have data for a given color (gray areas in Fig. 2, 
hereinafter 'missing pixels') are interpolated using pixels for which data is 
properly input (white areas in Fig. 2). In this embodiment, the interpolation is 
performed by taking an average of the data actually obtained for pixels in a 3x3- 

10 pixel area surrounding the missing pixel. Through this interpolation, R, G and B 
complete pixel data is obtained. By overlapping the R, G and B complete pixel 
data, one item of image data is obtained. 

The signal processing sequence in a digital camera 1 having the 
construction described above will be explained with reference to Fig. 3. The 

15 digital camera 1 first controls the image pickup lens 2 (see Fig. 1) in relation to the 
photo object, and when an image is formed on the CCD image pickup unit 3, the 
input image is converted into electrical signals (SI). In step S2, the electrical 
signals are converted through A/D conversion to form digital image data based on 
the alignment of the R, G and B filters located so as to correspond to individual 

20 CCD pixels. The image data is then compressed if necessary (S3), and is recorded 
in the second memory 10 in step S4. This digital camera 1 simultaneously records 
as filter alignment data the alignment of the R, G and B filters that are located so 
as to correspond to the individual pixels of the CCD image pickup unit 3. This 
digital camera 1 has a preview function in which the image that entered the image 

25 pickup lens 1 is immediately displayed on the built-in LCD display unit 12 when 
the shutter button is pressed halfway down, for example, and during data 
processing when this function is present, the image data is digitally converted and 
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is immediately subjected to pixel data interpolation without being compressed, so 
that the sequence follows the arrow formed by the dashed line in Fig. 3. The 
compression of image data in step S3 in Fig. 3 will be described in detail below 
with reference to Fig. 7. 
5 In this embodiment, the captured image or recorded image is output to the 

built-in LCD display unit 12 of the camera 1 or to a display connected to the 
personal computer 20. When this is executed, the following additional processing 
is performed on the digital image data recorded in the second memory 10. 

The situation in which the image is output to a display connected to the 

10 personal computer 20 will first be explained. In this embodiment, the second 
memory 10 comprises an IC card, and consequently, the image data and filter 
alignment data recorded in the second memory 10 are input to the personal 
computer 20 by inserting this IC card into the data input unit 21 of the personal 
computer 20. This personal computer 20 has a dedicated reproduction software 

15 program that enables it to (1) read the input filter alignment data as well as the 

image data, (2) separate the image data into data of three different colors based on 
this filter aligimient data, and (3) perform interpolation for missing pixels. Using 
this program, the personal computer 20 can expand the input image data if 
necessary (SIO in Fig. 3) and separates the pixel data into R, G and B groups. It 

20 then can perform missing pixel interpolation in SI 1 . In this case, the user may 

select a desired interpolation method from among different interpolation methods 
incorporated as programs in the computer (the averaging method or the median 
method, for example). The R, G and B complete pixel data created through the 
processing described above is overlaid on itself and output on the display as a 

25 single color image. 

A case in which the image is output to the built-in LCD display unit 12 of 
the camera 1 will now be explained. Here, the image data and filter alignment 
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data recorded in the second memory 10 are read, with the IC card comprising the 
second memory 10 connected to the camera 1. The CPU 8 that controls the 
camera (see Fig. 1) expands the image data if necessary (S5 in Fig. 3) and 
separates the pixel data into R, G and B groups. It then performs interpolation for 
5 the missing pixels for each color in S6 using an mterpolation method incorporated 
in the camera. The R, G and B complete pixel data created through this 
processing is overlaid on itself and output to the LCD display unit 12 as a single 
color image. 

The built-in LCD display unit 12 of the camera 1 has much fewer pixels 

10 than the CCD of the image pickup unit 3, but since the purpose of the image 

display in the LCD display unit 12 is often confirmation of the image composition 
and color rather than close-range image viewing, it does not pose any problems for 
the quality of the displayed image to be slightly lower. Consequently, if a simpler 
method is used for the pixel data interpolation method incorporated in the camera, 

15 the circuit size or program capacity may be reduced. 

As can be seen from the explanation given above, in the digital camera 1 of 
this embodiment, the digital image data obtained through A/D conversion is 
recorded in the second memory 10 before it is interpolated for missing pixels for 
each color, i.e., R, G and B. In this second memory 10 is also recorded the 

20 aligmnent of the R, G and B filters that are located so as to correspond to 

individual CCD pixels, as filter aligmnent data. Therefore, in this digital camera 
1, the image data and filter alignment data are read from the second memory 10 as 
the image is output, and based on the filter aligmnent data, the image data is 
separated into three different colors and pixel data interpolation is performed for 

25 each color, whereupon R, G and B complete pixel data is created (see Fig. 4). 

By means of this construction, the R, G and B complete pixel data need not 
be recorded in the recording medium as it is in the example of the prior art, and 
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the amount of data recorded in the second memory 10 may accordingly be 
reduced. 

Furthermore, in this embodiment, where the image data recorded in the 
second memory 10 is output to the personal computer 20, the user can select an 
5 image data interpolation method from among various interpolation methods 
incorporated in the personal computer 20 as programs. For example, where a 
more sophisticated interpolation method is programmed into the personal computer 
20, the quality of the unage output to the display may be unproved by selecting 
this method. 

10 In this embodunent, the Bayer type array described above is used for the 

alignment of the R, G and B filters located so as to correspond to individual CCD 
pixels. There are four types of Bayer arrays, as shown in views (a) through (d) of 
Fig. 5. The 36 pixels at the upper left corner of the CCD are shown for each type 
of Bayer array. In the digital camera 1, the Bayer array to be used is 

15 predetermined to be one of these types (a) through (d), and filter alignment data 
representing that Bayer array is recorded in the second memory 10 together with 
the image data. 

The present invention is not limited to this approach, however, and it is 
possible to set the alignment of the R, G and B filters located so as to correspond 

20 to individual CCD pixels, such that it may be changed as desired. In this case, 

alignment data indicating that the filter alignment represents a Bayer type array, as 
well as the type (a) through (d) that has been adopted, will be recorded as filter 
alignment data recorded in the second memory 10. 

Further, views (a) and (b) of Fig. 6 show special R, G and B filter 

25 alignments different from the Bayer type array. In this case, the data mdicating the 
number of pixels in the X direction of the smallest block imit that is repeated from 
the upper left corner of the CCD and the number of pixels in the Y direction of the 
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same block unit, as well as the pixel color data beginning from the leftmost pixel 
of the first row, are recorded in the second memory 10. Here, R (red), G, 
(green), B (blue), C (cyan), M (magenta), and Y (yellow) are set as color data, for 
example. 

5 Regarding the filter alignment shown in view (a) of Fig. 6, the smallest 

block unit is 3 x 3, and the block comprises RGBBRGGBR in that order beginning 
from the leftmost pixel of the first row. Therefore, the filter alignment data is 
expressed as X = 3, Y = 3; 0, 1, 2, 2, 0, 1, 1, 2, 0, where 0 represents red, 1 
represents green and 2 represents blue. 
10 Regarding the filter alignment shown in view (b) of Fig. 6, the smallest 

block unit is 3 x 1 and the block comprises RGB in that order begiiming from the 
leftmost pixel. Therefore, the filter alignment data is expressed as X = 3, Y = 1; 
0, 1, 2. 

The filter aligimient data is recorded in the second memory 10 together 
15 with the image data in the same way as in the previous embodunent. Using this 
method, special alignments of R, G £ind B filters located so as to correspond to 
individual CCD pixels can be handled. 

The compression of the image data (S3 in Fig. 3) will now be explained 
with reference to Fig. 7. In this embodiment, the widely used discrete cosine 
20 transformation (DCT) method is used to perform JPEG compression. By means of 
this JPEG compression, compression devices and expansion devices currently in 
wide use can be employed and the cost may be reduced accordingly. In this 
embodiment, the following processing is performed during JPEG compression. 
As shown in Fig. 7, R, G and B pixel data is aligned based on the Bayer 
25 type array using the image data after A/D conversion. During compression, the R, 
G, and B pixel data in the image data is realigned such that a block will be formed 
for each color. G pixels are horizontally displaced to the left such that they will 
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form a block accounting for half the image data, and R and B pixels are collected 
in the upper right side and lower right side respectively while maintaining their 
positional relationships in the original image data, such that pixels of each color 
will form a block accounting for one-quarter of the image data. The method of 
5 placement of each color block is determined in advance. 

Y data (i.e., brightness data) is deemed to be the image data comprising R, 
G and B color, all pixels with regard to Cr and Cb data (in other words, color 
difference data) are deemed '0', and JPEG compression is performed using a high 
Cr and Cb thinning ratio of 4: 1 : 1 . The image data compressed in this way is 

10 recorded in the second memory 10 together with the filter alignment data. 

By gathering together the R, G and B pixel data during the compression of 
the image data in this way, the correlations between neighboring pixels may be 
increased so that the rate of compression may increase. In addition, smce the data 
conversion of R, G, and B into Y, Cr and Cb can be simplified, the required 

15 program memory capacity may be reduced. During data expansion, the data is 
expanded based on the JPEG standard, and the image data can be obtained by 
realigning the pixel data based on the filter alignment of the original image data. 

The signal processing sequence in a digital camera pertaining to the second 
embodiment of the present invention will now be explained with reference to Fig. 

20 8. In this embodunent, a recording medium that records the image data and filter 
aligimient data is mounted in a camera 21. Therefore, where the image is to be 
output to an external device such as a personal computer 30, the rniage data and 
filter alignment data are output externally either by means of a cable or by infrared 
communication. Since the data processing in this digital camera 21 (S21 through 

25 S28) is the same as the data processing in the digital camera 1 pertaining to the 

first embodiment described above (SI through S8 in Fig. 3), it will not be further 
explained here. 
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Where the image is to be output to a display connected to the personal 
computer 30, the unage data and filter alignment data recorded in the second 
memory 10 are input to the personal computer 30 using either a cable or infrared 
communication in this embodiment, as mentioned above. This personal computer 
5 20 records the input image data and filter alignment data in step S30. While 

reading the recorded image data and filter alignment data as needed, it separates 
the image data into three different colors and performs pixel data interpolation for 
missing pixels (S31 through S33) based on the filter alignment data, as in the case 
of the first embodiment (SIO through S12 in Fig. 3). The R, G and B complete 

10 pixel data created through this processing is overlaid on itself and output on the 
display as a single color unage. 

The signal processing sequence in a digital camera pertaining to a third 
embodiment of the present invention will be explained below with reference to 
Fig. 9. In this embodunent, emphasis is placed on compatibility, such that where 

15 the image is output externally, prior to being output the digital image data is 

converted into a format that may be reproduced by another reproduction device. 
The data processing in a digital camera 41 (S41 through S48) is the same as the 
data processing in the digital camera 1 pertaining to the first embodiment 
previously described (SI through 8 in Fig. 3), and accordingly will not be further 

20 explained here. 

When the image is output to a personal computer 50, the digital camera 41 
separates the digital image data into pixel data of the three different colors based 
on the filter alignment data, and after performing interpolation for the missing 
pixels for each color, it compresses the R, G and B complete pixel data obtained 

25 through the interpolation (S49). The complete pixel data that comprises the image 
is input to the personal computer 50 using either a cable or infrared 
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communication. At the same time, the recorded filter alignment data recorded in 
the recording medium in the digital camera 41 is input as well. 

The personal computer 50 records the R, G, and B complete pixel data and 
filter alignment data in step S50. It then reads the complete pixel data it recorded 
5 and expands it (step S51). Through this processing, the R, G and B complete pixel 
data created in the digital camera 41 is reproduced (S52) and the image may be 
displayed. 

This personal computer 50 has a dedicated software program that enables it 
to read the filter alignment data input together with the R, G and B complete pixel 

10 data and to detect from the complete pixel data, based on the filter alignment data, 
the image data prior to the performance of interpolation for missing pixels in the 
digital camera 41. Through this program, the personal computer 50 converts the 
R, G and B complete pixel data expanded in step S51 into pixel data, including 
missing pixels, based on the filter alignment data, and can then perform 

15 interpolation for these missing pixels once more in step S53 (see Fig. 10). In this 
case, the user can select a desired interpolation method from among the 
interpolation methods incorporated in the personal computer 50 as programs. 
Thus, a simple form of interpolation might be carried out at step S46 in the camera 
41, whereas more sophisticated interpolation techniques can be employed at step 

20 S53 in the personal computer 50. The R, G and B complete pixel data created 

through this processing is overlaid on itself and is output on the display as a single 
color image. In this embodiment, it is preferred that the data compression ratio in 
step S49 be set as low as possible. 

The present invention is not limited to these embodiments explained as 

25 examples above, but may, needless to say, be unproved or changed in design in 
various ways within the scope of the essence of the invention. 
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As can be seen ftom the explanation provided above, because the digital 
camera of the present invention has a data control means that separates the digital 
image data into pixel data of three different colors based on the filter alignment 
data and interpolates for missing pixels for each color, as well as a display means 
that reproduces the image comprising complete pixel data of the three different 
colors obtained by the data control means, the user can confirm the image in the 
built-in monitor of the camera if necessary. 

In addition, since the digital image data after A/D conversion is recorded 
on a recording medium before pixel interpolation is performed for each color, to 
obtain R, G and B complete pixel data, the data storage capacity of the recording 
mediimi may be reduced. Further, using the present invention, when the unage is 
output to an external device, because the image data is output after it is converted 
into R, G and B complete pixel data, it can be easily reproduced by an external 
reproduction device. 

Moreover, since the device of the present uivention has a display means to 
reproduce the image comprising complete pixel data of three different colors 
obtained from the data control means, the user may confirm the image on the built- 
in display unit of the camera if necessary. 
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What is claimed is: 

1 . A digital camera that records a captured image as digital data, said 
digital camera having: 

an image pickup device equipped with color filters that are located so as to 
correspond to individual pixels and that perform color separation of the image 
signals; 

an A/D converter that converts the image signals obtained by said image 
pickup device into digital image data; 

a recording device that records, together with said digital image data, data 
regardmg the alignment of the color filters located so as to correspond to 
individual pixels, 

a data processor that, after performing color separation of said digital 
image data into pixel data of different colors based on said recorded filter 
aligimient data, interpolates for missing pixels for each color; and 

a display device that reproduces the image comprising complete pixel data 
of different colors that is obtamed from the data processor. 

2. A digital camera as claimed in Claim 1, wherein said recording 
device includes a memory card that is detachable from said digital camera. 

3 . A digital camera as claimed in Claim 1 , said digital camera having 
an output unit that outputs the digital image data and filter alignment data to an 
external device. 

4. A digital camera that records an image as digital image data, said 
digital camera having: 
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an image pickup device equipped with color filters that are located so as to 
correspond to individual pixels and that perform color separation of the unage 
signals; 

an A/D converter that converts the image signals obtained by said image 
pickup device into digital image data; 

a recording device that records, together with said digital image data, data 
regarding the alignment of the color filters located so as to correspond to 
individual pixels, 

a data processor that, after performing color separation of said digital 
image data into pixel data of different colors based on said recorded filter 
alignment data, interpolates for missing pixels for each color to produce complete 
pixel data for each color; and 

an output unit that outputs to an external device the complete pixel data of 
each color obtained from said data processor together with the filter alignment data 
recorded on said recording device. 

5. A digital camera as claimed in Claim 4, said digital camera having a 
display device that reproduces the image comprising the complete pixel data of 
each color that is obtained from said data processor. 

6. A method for recording and displaying an image, comprising the 
steps of: 

sensing an image with an image sensor having an array of pixels, where 
each pixel generates data relating to one of a plurality of colors; 

storing the data generated by the individual pixels of the image sensor at a 
first site; 
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storing information which describes the colors that are respectively 
associated with the individual pixels in said array at said first site; 

transmitting the stored data and the stored information from said first site to 
a second site; 

interpolating said data at said second site in accordance with said stored 
information to generate complete color data for the individual pixels; and 
reproducing the image in accordance with the complete color data. 

7. The method of claim 6 wherein each of said pixels in the image 
sensor generates data relating to one of three colors, and said complete color data 
comprises a combination of all three colors for any individual pixel. 

8. The method of claim 6 further including the step of performing a 
first interpolation of the stored data at said first site, in accordance with said 
information, to produce a first set of complete color data, transmitting said first set 
of complete color data to said second site, and reinterpolating said first set of 
complete color data at said second site in accordance with said stored information, 
using a different interpolation process, to produce a second set of complete color 
data. 

9. The method of claim 6 further including the step of compressing the 
image data at said first site prior to transmitting it to said second site. 

10. A digital camera that records a captured image as digital data, said 
digital camera comprismg: 

an image pickup device having individual pixels that sense different 
respective components of an image; 
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an A/D converter that converts image signals produced by said image 
pickup device into digital image data; 

a recording device that records, together with said digital image data, data 
regarding the arrangement of said individual pixels of the image pickup device 
5 relative to said different components; 

a data processor that performs separation of said digital image data into 
pixel data of different components based on said recorded pixel arrangement data, 
and interpolates for missing pixels for each component; and 

a display device that reproduces the unage comprising complete pixel data 
10 of different components that is obtained from the data processor. 

11. A digital camera as claimed in Claim 10, wherein said recording 
device includes a memory card that is detachable from said digital camera. 



12. A digital camera as claimed in Claim 10, said digital camera having 
an ou^ut unit that outputs the digital unage data and pixel arrangement data to an 
15 external device. 



13. A digital camera that records an image as digital image data, said 
digital camera comprising: 

an image pickup device having individual pixels that sense different 
respective components of an image; 
20 an A/D converter that converts image signals produced by said image 

pickup device into digital image data; 

a recording device that records, together with said digital image data, data 
regarding the arrangement of said individual pixels of the image pickup device 
relative to said different components; 
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a data processor that performs separation of said digital image data into 
pixel data of different components based on said recorded pixel arrangement data, 
and interpolates for missing pixels for each components to produce complete pixel 
data for each component; and 

an output unit that outputs to an external device the complete pixel data of 
each component obtained from said data processor together with the pixel 
arrangement data recorded on said recording device. 

14. A method for recording and displaying an image, comprising the 
steps of: 

sensing an image with an image sensor having an array of pixels, where 
each pixel generates data relating to one of a plurality of different components of 
an image; 

Storing the data generated by the individual pixels of the image sensor at a 
first site; 

storing information which describes the arrangement of the individual 
pixels in said array, relative to said different components, at said first site; 

transmitting the stored data and the stored information from said first site to 
a second site; 

interpolating said data at said second site in accordance with said stored 
information to generate complete image data for each of the individual pixels; and 
reproducing the image in accordance with the complete image data. 

15. The method of claim 14 wherein each of said pixels in the image 
sensor generates data relating to one of a plurality of colors, and said complete 
image data comprises a combination of said plurality of colors for each individual 
pixel. 
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16. The method of claim 14 further including the step of performing a 
first interpolation of the stored data at said first site, in accordance with said 
information, to produce a first set of complete image data, transmitting said first 
set of complete image data to said second site, and reinterpolating said first set of 
complete image data at said second site in accordance with said stored information, 
using a different interpolation process, to produce a second set of complete image 
data. 
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ABSTRACT OF THE DISCLOSURE 

A digital camera employs an image sensor with color filters that correspond 
to individual pixels of the sensor. Image data detected by the sensor is recorded, 
together with data regarding the aligmnent of the color filters. The image data and 
5 the recorded alignment data are transmitted to a device external to the camera, 

where the image data is interpolated to produce complete color data for each pixel 
of the image. The complete color data is used to display the image. By means of 
this technique, the camera only needs to store and transmit the original image data, 
rather than interpolated complete image data. In addition, various interpolation 
10 processes can be employed in the external device, according to the particular 
desires of the user. 
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COMBINED DECLARATION AND POWER OF ATTORNEY 
FOR UTILITY PATENT APPLICATION 



Attorney's Docket No. 
018656-045 



As a below-named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated below next to my name; 

I BELIEVE I AM THE ORIGINAL, FIRST AND SOLE INVENTOR (if only one name is listed below) OR AN 
ORIGINAL, FIRST AND JOINT INVENTOR (if more than one name is listed below) OF THE SUBJECT MATTER 
WHICH IS CLAIMED AND FOR WHICH A PATENT IS SOUGHT ON THE INVENTION ENTITLED: 



DIGITAL CAMERA 



the specification of which 

(check one) is attached hereto: 

12 was filed on December 3. 1998 as 



Application No. 

and was amended on 

(if applicable) 



I HAVE REVIEWED AND UNDERSTAND THE CONTENTS OF THE ABOVE-IDENTIFIED SPECIFICATION, 
INCLUDING THE CLAIMS, AS AMENDED BY ANY AMENDMENT REFERRED TO ABOVE; 

I ACKNOWLEDGE THE DUTY TO DISCLOSE TO THE OFFICE ALL INFORMATION KNOWN TO ME TO BE 
MATERIAL TO PATENTABILITY AS DEFINED IN TITLE 37, CODE OF FEDERAL REGULATIONS, Sec. 1.56 
(as amended effective March 16, 1992); 

I do not know and do not believe fbe said invention was ever known or used in the United States of America before 
my or our invention thereof, or patented or described in any printed publication in any coimtry before my or our 
invention thereof or more than one year prior to said application; that said invention was not in public use or on sale 
ui the United States of America more than one year prior to said application; that said invention has not been patented 
or made the subject of an inventor's certificate issued before the date of said application in any country foreign to the 
United States of America on any application filed by me or my legal representatives or assigns more than twelve 
months prior to said application; 

I hereby claim foreign priority benefits under Title 35, United States Code Sec. 1 19 and/or Sec. 365 of any foreign 
application(s) for patent or inventor's certificate as indicated below and have also identified below any foreign 
application for patent or mventor's certificate on this invention having a filing date before that of the application(s) on 
which priority is claimed: 
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COUNTRY/INTERN ATI ON AL 


APPLICATION NUMBER 


DATE OF FILING 

(day, month, year) 


PRIORITY 
CLAIMED 


Japan 


09-332813 


03 Dec. 97 


YESJL N0_ 








YES NO 



COMBINED DECLARATION AND POWER OF ATTORNEY 
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018656-045 



I hereby appoint the following attorneys and agent(s) to prosecute said application and to transact all business in the Patent 
and Trademark Office connected therewith and to file, prosecute and to transact all business in connection with international 
applications directed to said invention: 



William L. Mathis 


17,337 


George A. Hovanec, Jr 


28,223 


Peter K. Skiff 


31,917 


Peter H Smolka 


15,913 


James A. UBarre 


28,632 


Richard J. McGrath 


29,195 


Robert S Swecker 


19,885 


E. Joseph Gess 


28,510 


Matthew L, Schneider 


32,814 


PlatotiN. Mandros 


22,124 


R. Danny Huntington 27,903 




Michael G. Savage 


32,596 


Benton S. Duffett, Jr. 


22,030 


Eric H. Weisblatl 


30,505 


Gerald F. Swiss 


30,113 


Norman H. Stepiio 


22,716 


James W Peterson 


26,057 


Michael J, Ure 


33,089 


Ronald L GrudzieckL 


24,970 


Teresa Stanek Rea 


30,427 


Charles F. Wieland m 


33,096 


Frederick G. Michaud, Jr. 


26,003 


Robert E. Krebs 


25,885 


Bruce T. Wieder 


33,815 


Alan E. Kopecki 


25,813 


William C. Rowland 


30,888 


Todd R. Walters 


34,040 


Regis E. Slutter 


26,999 


T. Gene Dillahunty 


25,423 






Samuel C. Miller, III 


27,360 


Patrick C. Keane 


32,858 






Ralph L. Freeland, Jr. 


16,110 


Bruce J. Boggs, Jr. 


32,344 






Robert G. Mukai 


28,531 


William H. Benz 


25,952 







and: 

Address all correspondence to: Platon N. Mandros 

Burns, Doane, Swecker & Mathis, L.L.P. 
P.O. Box 1404 

Alexandria, Virginia 22313-1404 

Address all telephone calls to : James A. LaBarre at (703) 836-6620. 

I hereby declare that all statements made herein of my own knowledge are true and that all statements made on 
information and belief are believed to be true; and further that these statements were made with the knowledge that willfiil 
false statements and the like so made are punishable by fine or imprisonment, or both, under Section 1001 of Title 18 of 
the United States Code and that such willful false statements may jeopardize the validity of the application or any patent 
issued thereon. 



FULL NAME OF SOLE OR FIRST INVENTOR 
HIROYUKl OKADA 


SIGNATURE | DATE 


RESIDENCE - do Minolta Co , Ltd., 


CITIZENSHIP 
JAPAN 


POST OFFICE ADDRESS 

c/o Minolta Co., Ltd., Osaka Kokusai BIdg., 3-13, 2-Chome, Azuciii-Machi, Chuo-Ku, Osaka-Slii, Osaka, JAPAN 


FULL NAME OF SECOND JOINT INVENTOR, IF ANY 


SIGNATURE 


DATE 


RESIDENCE 


CITIZENSHIP 


POST OFFICE ADDRESS 


FULL NAME OF THIRD JOINT INVENTOR, IF ANY 


SIGNATURE 


DATE 


RESIDENCE 


CITIZENSHIP 


POST OFFICE ADDRESS 
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